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(54) SIGNAL PROCESSOR 

(57)Abstract: 

PURPOSE: To provide a signal processor which is 
decreased in circuit scale and reduced in the number of 
constituent components without sacrificing 
characteristics of convolution processing. 
CONSTITUTION: This signal processor consists of a 
scanning converting circuit 1 which divides a two- 
dimensional digital data array into plural blocks and 
converts input data obtained by scanning the blocks, one 
by one, into the scanning order of an array format, data 
buffers 3-1 and 3-2 which delay the output data from 
the scanning converting circuit 1, S/P converting 
circuits 2-1, 2-2, and 2-3 which output output data from 
the scanning converting circuit 1 or data buffers 3-1 and 
3-2 in parallel, a shift register array 4 which stores the 
data from the S/P converting circuits, a data selector 7 
which takes data out of the shift register array 4, and a 
convolution processing circuit 8 which performs the 
convolution processing by using the taken-out data and 
a two-dimensional coefficient array. 
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* NOTICES * 

JPO and NCI PI are not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2. **** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1] In the signal processor which performs convolution processing with the input data of 
time series and the two-dimensional predetermined multiplier array which divided the two- 
dimensional digital data array into two or more blocks of predetermined magnitude, scanned for 
every block, and were acquired The scan conversion circuit changed in order of the scan of a 
train format of the scan sequence of said input data, The number of data which multiplied the 
number of the data which constitute one line of a digital data array two-dimensional [ said ], and 
the number of the data which constitute one train of a block of said predetermined magnitude is 
made into one stage. The delay means which predetermined number[ of stages ]-delays the data 
outputted from said scan conversion circuit, and can output the lag data for every stage, The 
serial/parallel-conversion circuit which considers the lag data of each stage of this delay means, 
and the output data from said scan conversion circuit as an input, and outputs the string data 
within the same block to juxtaposition, The shift-register array which stores a predetermined 
number of data while shifting from this serial/parallel-conversion circuit the data outputted to 
juxtaposition for every data with the same line address, The data selector which picks out two or 
more data required for convolution processing from the data stored in this shift-register array, 
The signal processor which consists of a convolution processing circuit which performs 
convolution processing using two or more data taken out by this data selector and said two- 
dimensional predetermined multiplier array. 

[Claim 2] The signal processor according to claim 1 characterized by omitting said scan 
conversion circuit by specifying in order of the block scan of a train format of the scanning 
direction of said input data. 

[Claim 3] The signal processor according to claim 1 or 2 characterized by constituting so that 
said serial/parallel-conversion circuit may be made to unify the function of said shift-register 
array when the number of the trains which constitute said two-dimensional multiplier array is 1. 
[Claim 4] A signal processor given in any 1 term of claims 1-3 characterized by adding the 
circuit which performs filtering of a line writing direction to the output from said convolution 
processing circuit 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Industrial Application] This invention divides a two-dimensional digital data array into two or 
more blocks, and relates to the signal processor which performs convolution processing with the 
input data of the time series scanned and acquired for every block, and a two-dimensional 
predetermined multiplier array. 
[0002] 

[Description of the Prior Art] For example, the configuration as generally shows the two- 
dimensional convolution processor using the two-dimensional multiplier array of nine-line nine 
trains to drawi ng 4 R> 4 is used. That is, when the input data of the time series acquired by 
scanning a two-dimensional digital data array is not raster scan sequence as shown in drawin g 
5 , it is the scan conversion circuit 101 first. It is changed in order of a raster scan. And scan 
conversion circuit 101 The data of the time series of the acquired raster scan sequencie are the 
shift-register array 103 while being delayed by the delay means 102-1 with the amount of delay 
for several data minutes which constitutes one line (it is defined as a line) of the two- 
dimensional digital data array of a basis, i.e., a line buffer. It is supplied. Moreover, the output 
from this line buffer 102-1 is the shift-register array 103 in a line buffer 102-2. It is supplied. 
[0003] Similarly, the output of each line buffer 102-2 to 102-7 is the shift-register array 103 in 
the line buffer 102-3 to 102-8 of the next step, respectively. It is supplied and the output of the 
last line buffer 102-8 is also the shift-register array 103. It is supplied. Only the number which 
subtracted 1 from the number of the multipliers which constitute one train of a multiplier array is 
required for these line buffers 102-1 to 102-8, and, in the case of this example of a 
configuration, eight line buffers are needed. From each line buffer 102-1 to 102-8, eight data 
which it delayed one line at a time to the input data, respectively are outputted. That is, nine 
data located in a line in the direction of a train including the input data are the shift-register 
arrays 103. It will be supplied. 

[0004] Shift-register array 103 It consists of two or more shift registers D00-D88 with the same 
number of stages as the number of the multipliers which constitute one line of a multiplier array 
(in the case of this example of a configuration, they are nine stages), and the data of a before 
[ eight ] are stored for every line. Only the same number as the number of the multipliers which 
constitute one train of a multiplier array is required for a shift register, and, in the case of 
[ nine ] this example of a configuration, it is needed. 

[0005] By taking the above configuration, it is the shift-register array 103. Upwards, the partial 
array (nine-line nine trains) of the two-dimensional data array of a basis is reconfigu rated. For 
example, when the data of the beginning of the 1 st line are stored in a register D00, the data of 
the beginning of the 2nd line are stored in a register D01, and the 9th data of the 9th line are 
stored for the 2nd data of the 1st line in a register D88 by the register D10. Thus, the 
reconfigurated partial array is equivalent to the two-dimensional multiplier array (nine-line nine 
trains). Namely, this shift-register array 103 The data and the multiplier array which were stored 
are used and it is the convolution processing circuit 104. It can set and convolution processing 
can be performed. And scan conversion circuit 105 which returns the result to the raster scan of 
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a basis It can mind and output. 
[0006] 

[Problem(s) to be Solved by the Invention] The data size treated in the processing field of the 
image data which is typical two-dimensional data is large, and the inclination large-scale-ized 
increasingly is strong. Moreover, in fields, such as record of image data, and a communication 
link, in order to compress the amount of data, many conversion coding is used and, as for the 
scan sequence of data, a block scan is becoming general. 

[0007] However, in the signal processor which performs the conventional convolution processing 
shown in drawing 4 , since it is required that input data should be raster scan sequence, the scan 
conversion circuit changed in order of a raster scan for processing the data of block scan 
sequence is indispensable. Furthermore, the scan conversion circuit returned to a scan format of 
a basis is also needed after convolution processing with a latter configuration. 
[0008] the raster scan sequence from block scan sequence — or in order to change from raster 
scan sequence in order of a block scan, it is necessary to use a random and accessible storage 
means like SRAM For example, although the control approach of SRAM is devised, it is the 
minimum capacity and this processing is realized, a number of the data of number x1 line of data 
of capacity which still constitute one train of one block is required of L64765 which is LSI of 
LSI-LOGIC. That is, when the capacity of this storage means processes image data especially 
depending on the size of the two-dimensional data to process, a very mass thing is required. And 
since it is difficult, uniting this storage means with other circuits, and integrating prepares a 
storage means independently in many cases. However, in addition to components increasing in 
number, many signal lines, such as the address and data, were needed, and the space factor was 
reduced. 

[0009] Moreover, since a large-scale thing is required depending on data size, the line buffer for 
obtaining the data of the direction of a train simultaneously also uses and constitutes a general- 
purpose data buffer like FIFO in many cases. However, several [ of the multiplier which 
constitutes one train of a multiplier array ] -The number of only 1 (at the conventional example 
shown in drawin g 4 , it is 8) is needed, and a space factor is reduced remarkably. Therefore, 
measures, such as reducing the line count of a multiplier array at the sacrifice of the property of 
convolution processing, were taken. 

[0010] it be made in order that this invention may cancel the above-mentioned trouble in the 
signal processor which perform the conventional convolution processing , and it aim at provide 
the signal processor it enabled it to reduce in the number of the components which constitute a 
circuit , without sacrifice the property of convolution processing for invention according to claim 
1 in the equipment which perform convolution processing with the data which input in order of 
block scans other than a train format as show in drawin g 6 , and a two-dimensional multiplier 
array . Moreover, invention according to claim 3 aims invention according to claim 4 at offering 
the signal processor which can reduce the number of multiplication [ in / convolution 
processing ] for the purpose of offering the signal processor which can omit a shift-register 
array for the purpose of invention according to claim 2 offering the signal processor which can 
omit a scan conversion circuit. 
[0011] 

[Means for Solving the Problem and its Function] In order to solve the above-mentioned trouble, 
invention according to claim 1 In the signal processor which performs convolution processing 
with the input data of time series and the two-dimensional predetermined multiplier array which 
divided the two-dimensional digital data array into two or more blocks of predetermined 
magnitude, scanned for every block, and were acquired The scan conversion circuit changed in 
order of the scan of a train format of the scan sequence of said input data, The number of data 
which multiplied the number of the data which constitute one line of a digital data array two- 
dimensional [ said ], and the number of the data which constitute one train of a block of said 
predetermined magnitude is made into one stage. The delay means which predetermined number 
[ of stages ]-delays the data outputted from said scan conversion circuit, and can output the lag 
data for every stage, The serial/parallel-conversion circuit which considers the lag data of each 
stage of this delay means, and the output data from said scan conversion circuit as an input, and 
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outputs the string data within the same block to juxtaposition, The shift-register array which 
stores a predetermined number of data while shifting from this serial/parallel-conversion circuit 
the data outputted to juxtaposition for every data with the same line address, The data selector 
which picks out two or more data required for convolution processing from the data stored in 
this shift-register array, A signal processor consists of convolution processing circuits which 
perform convolution processing using two or more data taken out by this data selector and said 
two-dimensional predetermined multiplier array. 

[0012] Also when it can omit in the scan conversion circuit itself when the block scan of the 
data become that it is possible to perform convolution processing to the data by which the block 
scan was carried out, therefore input is carried out in a train format, without changing in order of 
a raster scan by adopting such a configuration, and the block scan is carried out in the other 
format, compared with the case of conversion by the raster scan, it can constitute in a far 
small-scale circuit. For example, the conversion to the block scan of a train format from the 
block scan of a line format is realizable with the storage means of the same capacity as the 
number of the data which constitute one block, if the same art as the former is used. Moreover, 
the number of the delay means for obtaining the data of the direction of a train is also 
substantially reducible. 

[0013] Moreover, in a signal processor according to claim 1 f invention according to claim 2 is 
characterized by omitting a scan conversion circuit by specifying the scanning direction of input 
data in order of the block scan of a train format, and when input data is the scan sequence of a 
train format in this way, it can omit a scan conversion circuit. Moreover, in a signal processor 
according to claim 1 or 2, when the number of the trains which constitute a two-dimensional 
multiplier array is 1, invention according to claim 3 is constituted so that a serial/parallel- 
conversion circuit may be made to unify the function of a shift-register array. Thus, when the 
multiplier array consists of only one train, the output of a serial/parallel-conversion circuit can 
be supplied to an immediate-data selector, and a shift-register array can be omitted. Moreover, 
invention according to claim 4 adds the circuit which performs filtering of a line writing direction 
to the output from a convolution processing circuit in a signal processor given in any 1 term of 
claims 1-3. Thereby, the number of the multiplication in convolution processing can be reduced. 
[0014] 

[Example] Next, an example is explained. Drawin g 1 is the block block diagram showing the 
example of the signal processor concerning this invention. This example divides two-dimensional 
digital data into the block of four-line four trains, and applies this invention to the signal 
processor which was made to perform convolution processing with the data of the time series 
scanned and acquired for every block, and the two-dimensional multiplier array of nine-line nine 
trains. 

[0015] In drawin g 1_ , input data is data of the time series acquired by scanning a two- 
dimensional digital data array in order of a block scan synchronizing with the standup of a 
predetermined reference clock. And especially, as long as there is no assignment, suppose that 
processing of data is performed synchronizing with this reference clock (in addition in draw ing 1 , 
the reference clock is omitting the graphic display). 

[0016] Input data is first changed in order of the block scan of a train format by the scan 
conversion circuit 1. When the data of the sequence of a block scan of a train format are 
obtained from the beginning, this scan conversion circuit 1 can be omitted. The data changed in 
order of the block scan of a train format are delayed by the delay means 3-1 with a number (in 
the case of this example, it is 4) of data of the amounts of delay which constitute one train of 
the block of data number x1 ** of one line, i.e., a data buffer, while they are supplied to a serial / 
parallel (S/P) conversion circuit 2-1. The data delayed by this data buffer 3-1 are delayed by 
the data buffer 3-2 with the amount of delay for four more lines while they are supplied to the 
S/P conversion circuit 2-2. Two data buffers 3-1 and the data delayed by 3-2 by a total of eight 
lines are supplied to the S/P conversion circuit 2-3. 

[0017] The S/P conversion circuit 2-1 to 2-3 consists of shift registers 11 and the registers 12- 
1 to 1 2-4 for an output with a number (in the case of this example, it is 4) of data of the 
numbers of stages which constitute one train of one block, as shown in drawin g 2 . When all the 
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data for one train in the same block are stored on a shift register, the stored data are 
transmitted to the register 12-1 to 12-4 for an output. That is, from the S/P conversion circuit 
2-1 to 2-3, 12 data located in a line in the direction of a train will be outputted to juxtaposition, 
and will be supplied to the shift-register array 4. 

[0018] The shift-register array 4 consists of two or more shift registers D00-D88 with the same 
number of stages as the number of the multipliers which constitute one line of a multiplier array 
(in the case of this example, it is 9), and it is stored, shifting the data outputted from the S/P 
conversion circuit 2-1 to 2-3. From the S/P conversion circuit 2-1 to 2-3, since the data 
located in a line in the direction of a train are supplied, on the shift-register array 4, the partial 
array (nine-line 12 trains) of the data array of a basis is reconfigurated. 
[001 9] On the other hand, an address counter 5 counts a reference clock based on the 
synchronizing signal which synchronized with the input data, and detects and outputs the 
address of the data to input. A address decoder 6 outputs the control signal for choosing data 
required for convolution processing while generating the timing of the data transfer in the S/P 
conversion circuit 2-1 to 2-3, or the shift-register array 4 based on the address from an address 
counter 5. This control signal is specified, as it specifies centering on which data currently 
stored in the register of registers 44-D 47 convolution processing is performed and it is shown in 
drawing 3 to the timing of S/P conversion. 

[0020] A data selector 7 chooses two or more required data from the data stored on the shift- 
register array 4 based on the control signal inputted from a address decoder 6, and outputs them 
to the convolution filter of the convolution processing circuit 8. For example, when the control 
signal specifies the register D44, registers D00-D08, D10-D18, D20-D28, D30-D38, D40-D48, 
D50-D58 D60-D68, D70-D78, and the data stored in D80-D88 are read. When the control signal 
specifies the register D46, the data stored in register D02-D0A, D12-D1A, D22-D2A, D32-D3A, 
D42-D4A, D52-D5A, D62-D6A, D72-D7A, and D82-D8A are read. The convolution processing 
circuit 8 performs convolution processing using the data outputted from a data selector 7, and a 
predetermined multiplier array, and outputs the result through the scan conversion circuit 9 
changed into a scan format of a basis. 

[0021] Since convolution processing can be performed without changing the data inputted in 
order of a block scan by using the signal processor of such a configuration in order of a raster 
scan, the magnitude of a scan conversion circuit is reducible. Furthermore, the number of the 
delay means for obtaining the data of the direction of a train is also reduced substantially. For 
example, in this example, what has eight required pieces is reduced by two pieces in the 
conventional example. Therefore, convolution processing of a required property can be 
performed, without being bound to a space factor. On the other hand, although, as for the 
memory capacity per [ which is a delay means ] data buffer, a mass thing is required compared 
with the former, a mass thing like the frame buffer for images is supplied to the general-purpose 
data buffer comparatively cheaply, and there is no cost-demerit. 

[0022] Moreover, in the above-mentioned example, when input data is the block scan sequence 
of the train format from the beginning, the scan conversion circuit itself can be omitted, 
moreover, the thing for which the output of a S/P conversion circuit is used for direct 
convolution processing although the number of stages of a shift-register array showed the same 
thing as the number of the multipliers which constitute one line of a multiplier array in the 
above-mentioned example — the magnitude of a shift-register array — 1 stage ***♦** — 
things are made. Therefore, when a multiplier array is a train matrix which is one dimension, a 
shift-register array can be omitted. 

[0023] Furthermore, when a two-dimensional multiplier array is equivalent to what is obtained by 
applying the line matrix in a certain train matrix, two-dimensional convolution processing can be 
divided into processing of the direction of a train, and processing of a line writing direction, and 
can be performed. That is, two-dimensional convolution processing can be performed with the 
configuration which adds the processing circuit of a line writing direction to the configuration of 
the above-mentioned example. By taking this configuration, the number of the multiplication in 
convolution processing can be reduced. For example, in the convolution processing using the 
multiplier array of 9x9, the number of required multiplication can reduce from 81 to 18. 



http://www4.ipdl.ncipi.go.jp/cgi-bin/tran_web_cgi_ejje 



2005/09/09 



JP,08-V37830,A [DETAILED DESCRIPTION] 



5/5 ^— v 



[0024] 

[Effect of the Invention] Since convolution processing can be performed without changing the 
data inputted in order of a block scan in order of a raster scan according to invention according 
to claim 1 as explained based on the example above, the magnitude and the component parts of 
a scan conversion circuit are reducible, thereby, cutback of cost and improvement in the 
dependability of equipment can be aimed at, and effectiveness, such as reduction of power 
consumption or a radiation noise and compaction of the processing time, is also acquired further. 
Moreover, according to invention according to claim 2, the scan conversion circuit itself is 
omissible by making input data into the block scan sequence of a train format from the beginning. 
Moreover, when the number of the trains which constitute a two-dimensional multiplier array is 1 
according to invention according to claim 3, the function of a shift-register array can be given to 
a serial/parallel-conversion circuit, and a shift-register array can be omitted. Moreover, 
according to invention according to claim 4, the number of the multiplication in convolution 
processing can be reduced by adding the circuit which performs filter processing of a line writing 
direction to the output from a convolution processing circuit. 
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DESCRIPTION OF DRAWINGS 
[Brief Description of the Drawings] 

[Drawing 1] It is the block block diagram showing the example of the signal processor concerning 
this invention. 

[ Drawin g 2] It is the block block diagram showing the example of a configuration of the S/P 
conversion circuit in the example shown in drawin g 1 . 

[ Drawin g 3] It is drawing showing the timing of the output signal of the address decoder in the 
example shown in drawjngj. . 

[ Drawin g 4] It is the block block diagram showing the example of a configuration of the 
conventional signal processor. 

[Drawing 5] It is the explanatory view showing the mode of raster scan sequence. 
[ Drawin g"6] It is the explanatory view showing the mode of the block scan sequence of a train 
format. 

[Description of Notations] 

I Nine Scan conversion circuit 

2- 1 , 2-2, 2-3 S/P conversion circuit 

3- 1 , 3-2 Data buffer 

4 Shift-Register Array 

5 Address Counter 

6 Address Decoder 

7 Data Selector 

8 Convolution Processing Circuit 

I I Shift Register 

1 2-1 , 1 2-2 f 1 2-3, 1 2-4 Register for an output 
101,105 Scan conversion circuit 
102-1 to 102-8 Line buffer 

103 Shift-Register Array 

104 Convolution Processing Circuit 
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